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A method of na^gatin g in a virtual three-dimensional envtronment and an 
electronic device employing such method. 

6 

Technical field 

The rnvenfion relates to a method of navigating In a virtual threenlimensionai 
10 enviionment comprising a hierarchically organised menu system In an 
electronic device, wherein a movable physical meml)er for navigating In the 
three-dirnensional environment is controlled by applying a finger of a user to 
the movable physical member, and to an electronic device comprising a 
movable physical member for navigating In a virtual three-dimensional 
15 environment comprising a hierarchically organised menu system, said 
movable physical merrdjer being arranged for being controlled by a finger of 
a user applied to a user surface of the movable physical member. 

20 Related prior art 

The term "virtual three-dimensional environmenlf when used in this 
specification is to be understood as a hierarchically structured menu system 
as it Is commonly known In electronic devices, such as computers, mobile 
25 telephones, PDAs (Personal Digital Assistant), etc. 

There e»st different methods of navigating In such virtual three^imenslonal 
environmente in an electronic device* including the use of depressable keys, 
a joystidc or a soft-key provided on a display. In e.g. a mobile telephone the 

30 navigation Is conventionally performed by use of "Yes" and "No*' keys and a 
kind of scroll key that may comprise two keys (up/down or left/rfght). In this 
embodiment at least three and possibly four keys are necessary to navigate 
sideways and up and down In the hierarchy of the virtual three-dimensional 
environment This means that the finger used for navigating must be moved 

35 between these different keys. Additionally, it is known to employ a movable 
physical member, such as a Joystick, for navigating in a virtual three- 
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dimensional environment The joystick may be movable fn four different 
directions In the same plane and may also be depressed. By moving the 
Joystick In any one of the four directions in the same plane it is possible to 
navigate through a menu system of the virtual three-dimensional 
5 environment and by depressing the JoysHdc tfie actual command is entered 
into the electronic device. WO 01/28199 discloses an electronic device 
provided with such a Joystlclc which may be moved In four different directions 
and may be depressed. The electronic device is provided with means 
whereby a first function is achieved if the joystick is depressed for a long time 
1 0 and another f undUon if the Joystick is depressed for a short time only. ' 

A similar depressing-tfme dependent function Is disclosed In US-A-5 923 327 
in which the key to be depressed is Incorporated in a display screen and the 
user touches the display screen for navigating in the virtual three- 
1 5 dimensional environment 

Additional^, U&A1-2001/015718 discbses a touch sensitive Input device, 
such as a computer mouse or a keyboard, with a touch sensitive auxiliary 
controls s^em that can be used to anticipate a user's action. The system 
20 works by suggesting a certain operation depending upon which application is 
open, when a user^s hand approaches the touch sensitive input device, such 
as a particular key. Furthermore, it is described that successive touches of 
the same button within a predetermined period of time may cause different 
types of Information to be displayed, such as the button functionality. 

25 

When navigating In a virtual three-dimensional environment it is desirable to 
be able to navigate In six mutual^ right-angled diredJons. As described 
above this may be achieved by providing a plurality of hard keys and/or soft 
keys that each represents movement fn one or two directions when 
30 depressed, or by providing a joystick that allows movement in a plurality of 
directions. However, a disadvantage by the known electronic device provided 
with means for navlgatir^ in a virtual three-dimensional environment is that 
for moving upvrards in the hierarchy of commands a special key or a joystick 
must be depressed, possibly for a preset period of time. 

35 
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Depressing a key or a joystick for moving upwards In a virtual three- 
dimensional environment seems, however, to be Hloglcal since the 
movement of the finger of the user Is In the exact opposite direction, l.e. a 
downwardly depression. This problem haa been solved by a joystick 
5 disclosed in JP-8050532 which is movable In six different dfrectionsL With 
this joystick it is possible to navigate upwards simply by pulling the joystick 
upwards. 

However, this solutions Is impractical if the electronic device and thereby the 
10 movable physical member for navigation is small as it is the case when the 
electronfc device is e.g. a mobile telephone. 



Qblect of the invention 

15 

It is therefore an object of the Invention to provide a method and an 
electronic device for navigating In a virtual three-dlmensionai environment by 
applying a finger to a movable phy^^al member* in which method and 
electronto device the above-mentioned disadvantages have been overcome. 

20 

Summary of trie invention 

The object of the invention is achieved by providing the method mentioned in 
25 the opening paragrapli such that navigating a step upwards in a hierarchy of 
commands in the thnee*<limensional environment is achieved by removing 
the finger from the movable physical member and reapplying it to the 
movable physical member within a set time limit 

30 TTiereby a new and simple method of navigating upwards in the hierarchy of 
commands is obtained, which method does not require movement of the 
movable physical member as such or movement of the finger to another key 
to be depressed, but only requires a special movement of a finger applied to 
the movable physical member. Furthermore, the upwards navigation In the 

35 hierarchy of the virtual three-dimensional environment is in conformity with 
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the movement of the finger which is lifted or moved upwards before it is re- 
applied to the movable physical member. 

The time limit to re-apply the finger to the movable physical member may be 
5 set at any.deslred size. Prelerabiy, however. It Is below a few seconds which 
should be suitEdl>le for most appliances and most us^ns should be atolQ to 
remove and re-apply the finger within such time iimiL 

The object of the Invention is also achieved by providing the electronic 
10 device mentioned In the openings paragraph with a movable physical 
member that is provided with sensing means for sensing If a finger is applied 
to the user surface of the movable ph^icai member, which sensing means is 
electrically connected to a timer ananged to start counting when the finger is 
removed from the user surface of the movable physical member and to stop 
15 when the finger Is reapplied to the user sinface of ttie movable pt^sical 
m^ber. said electronic device being arranged to perfomn a step upwards In 
a hierardiy of commands in the virtual three-dimensional environment if the 
timer counting Is below a set limit. By providing the movable physical 
member with such sensing means ft is suitable for carrying out a new method 
20 of navigating in a virtual three-dimensional environment Furthermore, the 
step upwards in tiie vfrtual three-dimensionai envlixmment it is in confomnity 
with the movement of the finger which vM typically also be upwards vutien It 
is removed from the user surface of the movable physical member. 

25 in a first emt>odiment of the invention the sensing means comprises an IR 
Onfia red) diode and an IR detector anranged in such manner that the IR light 
is reflected from the IR diode to the IR detector by the finger when the finger 
is applied to or is in the proximity of tiie user surface of the movable physical 
member. When it is de^d to i^rtomn the navigsdion by the mefiiod 

30 according to the invention the finger must be removed and re-applied to the 
user surfeice of the movable physical member wittiin a short period of time. 
The finger must be removed to a distance where the IR light Is no longer 
reflected by the finger. 

35 The IR diode and the IR detector is preferably positioned at a base of the 
movable physical member, and two light guides extend from the base of the 
movable physical member to the user surface of the movable physical 
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member. Thereby the movable physical member can be made smaller than If 
the IR diode and the IR detector were to be incorporated In the movable 
physical member. 

5 In a second embodiment of the invention the sensing means comprises a 
micro svtdtch provided at the user surfiace of the movable physical member, 
which micro switch Is depressed when a finger is applied to the user surface 
of the movable physical member. By using a micro switch In connection with 
the user surface of the movable physical member it is easily registered 
1 0 whether a finger is applied to the user surface or not. 

In a tWfxl embodiment the sensing means comprises two conducive areas at 
the user surfeice of the movable physical member, which two conductive 
areas aie arranged to be electrically short-circuited when a finger is applied 
15 to the user surface, in this way it is also easily registered whefiier a finger is 
applied to the user surface or not. 

The electronic device is preferably prodded with a display adapted to 
graphically display at least a part of the menu system so that the user is 
20 as^sted in his navigation through the virtual tiiree-dimensional environment. 

In a prefenred embodirrient for the electronic device the movsd>le physical 
member is a joysticic that is movable In different directions. 

25 The invention is especially suitable for small electronic devices like a mobile 
communications device^ such as a mobile telephone. 

It shall be emphasised that the term "comprise/comprising" when used in this 
specification is talcen to specily the presence of stated features, integers, 
30 steps or components but does not preclude the presence or addition of one 
or more other featureSi int^ers, steps components or groups thereof. 
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Description of Ihe drawings 

35 

The invention will be described In detail In the fbltovi4ng \Mi reference to the 
drawings In which 
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Fig. 1 shows an electronic device according to the invention provided with a 
movable physical member; 

5 Fig. 2 shows a first embodiment of a movable physical member provided in 
an electronic device according to the invention; 

Fig. 3 shows a second embodiment of a movable physical member provided 
in an electronic device according to the invention; 

10 

Fig. 4 shows a third embodiment of a movable physical member provided in 
an electronic device according to the invention; and 

Fig. 5 shows a flow chart illustrating the process of the electronic device for 
1 5 performing the method of navigating according to the invention. 

Detailed description of an embodiment of the invention 

20 Fig. 1 shows an electronic device in the form of mobile telephone 1 
comprising a housing 2 with openings for keys 3, a display 4. a microphone 5 
and a loudspeaker 6. All these elements are generally known in the art and 
are not part of the present invention. 

25 Additionally, the mobile telephone 1 is provided with a movable physical 
member 7 that has, in the shown embodiment, the function of a joystick for 
navigating through a virtual three-dimensional environment provided in the 
mobile telephone 1 and being graphically displayed in the display 4. The 
movable physical member 7 is provided with a user surface 8 and is 

30 arranged to be movable in four different directions as indicated by the double 
arrows Pi and Pg, preferably by being tilted about a point at the lower end of 
the movable physical member 7. A movement of the movable physical 
member 7 in any one of these directions causes a certain navigation step in 
the virtual three-dimensional environment to be performed. The navigation 

35 step perfomried may be dependent on the state of the mobile telephone 1 
and of the actual position in the virtual three-dimensional environment. The 
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movable physical member 7 is also arranged to be depressable In orxJer to 
activate a demand at any chosen position in the virtual three-dimensional 
environment. 

5 In accordance with the invention, the movable physical member 7 Is 
furthemiore provided with sensing means for sensing If a finger or the like is 
applied to the user surface 8. The sensing means is connected to a timer in 
a processor provided in the mobile telephone 1 and if the processor registers 
that the finger is removed from and re-applled to the user surface 8 of the 

10 movable physical member 7 within a set time limit a predefined navigation 
step in the virtual three-dimensional environment is performed. In a prefen-ed 
embodiment the navigation step achieved is a movement upwards or 
backwards in the virtual three-dimensional environment. By ascribing such a 
navigation step to the action of removing and re-applying a finger to the user 

15 surface 8 of the movable physical member 7 within a set time limit, the 
movement of the finger (upwards) is in full confomriity with the desired 
direction of movement in the virtual three-dimensional environment. Other 
navigation steps may of course be ascribed to the action, If desired. 

20 Fig. 2 shows schematically a first embodiment of a movable physical 
member 7. The movable physical member 7 is rod-shaped and Is connected 
to the electronic device, such as the mobile telephone 1 shown In Fig. 1 , In a 
commonly known manner that will not be described In detail. A person skilled 
In the art of electronic devices can easily provide such connection. 

25 

As mentioned above with reference to Fig. 1 , the movable physical member 
7 is provided with a user surface 8 to which a finger 9 may be applied and is 
an-anged to be tiltable in the directions of the double arrows and P^. The 
movable physical member 7 is also depressable in direction of the arrow P3. 
30 A movable physical member 7 an^nged in this manner is generally known in 
the art. 

Apart from the provisions described above, the movable physical member 7 
is provided with sensing means for sensing if a finger is applied to the user 
35 surface 8 of the movable physical member 7. In the first embodiment shown 
in Fig. 2 the sensing means comprises an IR (infra red) diode 10 and an IR 
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detector provided at the base 12 of the movable physical member 7. The 
movable physical member 7 is provided with a first light guide 13 and a 
second light guide 14, each extending from the base 12 of the movable 
physical member 7 to the user surface 8 thereof. The IR diode 10 emits IR 
5 light illustrated by the an-ow L that, via the light guide 13, is guided to the 
user surface 8. If a finger 9 is applied to the user surface 8 or is in the 
proximity of the user surface 8 as shown in Fig. 2, the IR light L from the light 
guide 13 is reflected by the finger 9 and transmitted via the light guide 14 to 
the IR detector 11. In relation to this embodiment the tenn of "applying a 
1 0 finger 9 to the user surface 8" means any position of the finger 9 where the 
IR light L is reflected, i.e. the situation where the finger 9 is in physical 
contact with the user surface 8 as well as the situation where the finger 9 is 
positioned in the proximity of the user surface 8. 

1 5 Now, if the finger 9 Is removed from the user surface 8 or from its proximity, 
the IR light L will no longer be reflected which is registered in the electronic 
device. If the finger 9 Is re-applled to the user surface 8 within the set time 
limit, whereby reflection of the IR light L is registered again, the desired 
navigation In the three-dimensional environment is performed. If the finger 9 

20 is not re-applied to the user surface 8, no navigation will be performed. 

As shown schematically In Fig. 2, the IR detector 11 is connected to a timer 
15 which in turn is connected to a processor 16 provided In the electronic 
device. The timer 15 is programmed to start counting when the finger 9 is 

25 removed from the user surface 8 of the movable physical member 7 or from 
its proximity and to stop when the finger 9 is re-applied to the user surface 8. 
The processor 16 registers the counting and if the counting is within a set 
limit, i.e. if the finger 9 has been re-applied to the user surface 8 or its 
proximity within a set time limit, a certain predetermined navigation in the 

30 virtual three-dimensional environment is perfomied. 

The timer 1 5 is preferably provided as software within a processor, but it may 
also be a separate electronic component. The display 4 is connected to the 
processor 16 and displays the performed navigation graphically. 
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A second embodiment of a movable physical member T provided in an 
electronic device according to the invention is shown In Fig. 3. This movable 
physical member T is also movable in the directions of the double arrows 
and Pj as well as being depressable in the direction of the arrow P3. The 
5 movable physical member T is provided with a user surface 8' that is a part 
of a micro switch 17 that is circuited whenever a finger 9 is applied to the 
user surface 8' of the movable physical member 7'. The micro switch 17 is 
very sensitive and will always be circuited when a finger 9 is applied to the 
user surface 8'. 

10 

This movable physical member T is also connected to a timer 15 that starts 
counting when the finger 9 is removed from the user surface 8', i.e. when the 
micro switch 17 is released, and stops when the finger 9 is re-applied to the 
user surface 8', i.e. when the micro switch 17 Is circuited again. The relation 
15 and structure of the timer 15. the processor 16 and the display 4 are as 
described above with reference to Fig. 2. 

A third embodiment of a movable physical member 7" provided in an 
electronic device according to the Invention is shown in Fig. 4. This movable 

20 physical member T is also movable in the directions of the double arrows P^ 
and P2 as well as being depressable in the direction of the anow P3. The 
movable physical member T is provided with a user surface 8" that is 
provided with two conducting plates 18,19 that are short-circuited when a 
finger 9 is applied to the user surface 8". Such resistive and/or capacitlve 

25 coupling is a commonly l<nown technique in which application of a finger 9 to 
the user surface 8" is detectable In a simple and reliable manner. 

This movable physical member T is also connected to a timer 15 that starts 
counting when the finger 9 is removed from the user surface 8", i.e. when 
30 the two conducting plates 18,19 are no longer short-circuited, and stops 
when the finger 9 is re-applied to the user surface 8', i.e. when the two 
conducting plates 18,19 are short-circuited again. The relation and stmcture 
of the timer 15, the processor 16 and the display 4 are as described above 
with reference to Fig. 2. 

35 
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The process performed by the electronic device according to the invention 
will be described in the following with reference to Fig. 5 that shows a flow 
chart illustrating this process. 

5 The initial step in the process is to detect whether a finger 9 is applied to the 
user surface 8,8',8" of the movable physical member 7,7',7'\ When a finger 9 
Is applied to the user surface 8,8',8" it must be detected if the finger is 
removed from the user surface 8,8\8" of the movable physical member 
7,7',7" since this may indicate that the navigation in the three dimensional 

10 environment according to the invention is to be performed. When it is 
detected that the finger 9 is removed from the user surface 8,8',8" the timer 
15 starts counting. If the finger 9 is not re-applied to the user surface 8,8",8" 
within a set time limit the timer stops counting and no navigation will be 
performed. In this case the process may start anew by detecting whether the 

15 finger 9 Is applied to the user surface 8,8',8" of the movable physical 
member 7,7',7". 

If. however, the finger Is re-applied to the user surface 8,8\8" of the movable 
physical member 7,7',7" within the set time limit the timer stops counting and 
20 a navigation according to the Invention Is performed. 

The time limit within which the finger 9 must be re-applied to the user surface 
8.8',8" of the movable physical member 7,7\7" In order to obtain the desired 
navigation can be set as desired. Preferably, however, the time limit Is below 
25 a few seconds and may be set at e.g. 0.5 second. 

If the finger 9 Is re-applied to the user surface 8,8',8" of the movable physical 
member 7,7\7" within the set time limit, the electronic device according to 
the invention registers it as a desire to perfomi the navigation in question. If 
30 the finger 9 is not re-applied within the set time limit, the electronic device will 
not treat the removal of the finger 9 as a wish to navigate, but simply as a 
removal the finger from the user surface 8,8',8" of the movable physical 
member 7, 7', 7" and no navigation steps will be performed. 

35 The invention has been described with reference to three embodiments of a 
movable physical member provided in an electronic device. Other 
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embodiments of the movable physical member are. however, possible, 
provided that they allow detection of whether a finger is applied to the user 
surface thereof or not. 
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